Random number generating systems and related methods

ABSTRACT

A method of identifying a memory cell state for use in random number generation (RNG) includes comparing at least one physical parameter of a memory cell with a threshold value of the physical parameter and identifying a relationship of the at least one physical parameter of the memory cell to the threshold value. A state of 0, 1, or X is associated to the memory cell based on the relationship of the at least one physical parameter to the threshold value. At least one state storage memory cell is programmed with a value corresponding with the associated 0, 1, or X state. The programmed value of the at least one state storage memory cell is included in an RNG data stream.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part application of the earlier U.S. Utility patent application Ser. No. 14/958,436 to Bertrand Cambou entitled “Physically Unclonable Function Generating Systems and Related Methods,” filed Dec. 3, 2015, now pending, which claims the benefit of the filing date of U.S. Provisional Patent Application 62/204,912 to Bertrand Cambou entitled “Physically Unclonable Function Generating Systems and Related Methods,” filed Aug. 13, 2015, now pending, the disclosures of each of which are hereby incorporated entirely herein by reference.

BACKGROUND

1. Technical Field

Aspects of this document relate generally to systems and methods designed to facilitate secure communications and interactions between devices.

2. Background

Secure communications between devices generally have been implemented using authentication protocols and methods. For example, some conventional systems involve encrypting the content of data or messages transmitted between a server and a client computing system. Other conventional systems have involved transmitting encoded messages, where the sending and receiving ends both have copies of the key to the code used.

SUMMARY

Implementations of methods of identifying a memory cell state for use in random number generation (RNG) may include: comparing at least one physical parameter of a memory cell with a threshold value of the physical parameter; identifying a relationship of the at least one physical parameter of the memory cell to the threshold value; associating one of a 0, 1, and X state to the memory cell based on the relationship of the at least one physical parameter to the threshold value; programming at least one state storage memory cell to store a programmed value corresponding with the associated 0, 1, or X state, and; including the programmed value of the at least one state storage memory cell in a RNG data stream.

Implementations of methods of identifying a memory cell state for use in RNG may include one, all, or any of the following:

Using the RNG data stream to create a portion of a data payload of a data packet.

The memory cell may be a first memory cell and the at least one state storage memory cell may be at least a first state storage memory cell, and the method may further include: comparing at least one physical parameter of a second memory cell with the threshold value of the physical parameter; identifying a relationship of the at least one physical parameter of the second memory cell to the threshold value; associating one of the 0, 1, and X state to the second memory cell based on the relationship of the at least one physical parameter to the threshold value; programming at least one second state storage memory cell to store a programmed value corresponding with the associated 0, 1, or X state, and; including the programmed value of the at least one second state storage memory cell in the RNG data stream.

The at least one state storage memory cell may be the memory cell itself.

Programming at least one state storage memory cell may further include programming a first state storage memory cell and a second state storage memory cell and: if the associated state of the memory cell is a 0, programming a 0 in the first state storage memory cell and programming a 1 in the second state storage memory cell; if the associated state of the memory cell is a 1, programming a 1 in the first state storage memory cell and programming a 0 in the second state storage memory cell; if the associated state of the memory cell is an X, programming one of a 0 in the first state storage memory cell and a 0 in the second state storage memory cell and programming a 1 in the first state storage memory cell and a 1 in the second state storage memory cell.

The first state storage memory cell may be included in a first row of memory cells and the second state storage memory cell may be included in a second row of memory cells adjacent to the first row.

The first state storage memory cell may be included in a first column of memory cells and the second state storage memory cell may be included in a second column of memory cells adjacent to the first column.

The RNG data stream may be an RNG binary data stream having 0 and 1 programmed values.

The memory cell may be selected from the group consisting of a static random access memory (SRAM), an SRAM-based ternary content-addressable memory (TCAM), a NAND flash memory, a NOR flash memory, a dynamic random access memory (DRAM), a resistive random access memory (ReRAM), a magnetic random access memory (MRAM), a spin transfer torque MRAM (STT MRAM), an electrically erasable programmable read-only memory (EEPROM), and any combination thereof.

Implementations of methods of random number generation (RNG) using memory cell states may include: comparing a physical parameter of each of a plurality of memory cells of a computing device with a first threshold value of the physical parameter and with a second threshold value of the physical parameter; identifying a relationship of each of the plurality of memory cells to the first threshold value and to the second threshold value; associating a 0 state to a first subset of the plurality of memory cells based on the relationship of the physical parameter of each memory cell of the first subset to the first threshold value; associating a 1 state to a second subset of the plurality of memory cells based on the relationship of the physical parameter of each memory cell of the second subset to the second threshold value; associating an X state to a third subset of the plurality of memory cells, wherein the physical parameter of each memory cell of the third subset is between the first threshold value and the second threshold value; programming a plurality of state storage memory cells to store programmed values corresponding with the third subset of memory cells having the X state; and including the programmed values of the third subset of memory cells in an RNG data stream.

Implementations of methods of RNG using memory cell states may include one, all, or any of the following:

Using the RNG data stream to create a portion of a data payload of a data packet.

Periodically testing the third subset of memory cells to generate new random numbers.

Randomizing an order of the programmed values corresponding with the third subset of memory cells prior to their inclusion in the RNG data stream.

Randomizing the order of the programmed values corresponding with the third subset of memory cells may be performed by a cryptoprocessor.

Retrieving, using a cryptoprocessor, the RNG data stream for communicating one of the RNG data stream and a random number generated using the RNG data stream.

Programming a plurality of state storage memory cells to store programmed values corresponding with the first subset of memory cells having the 1 state and programming a plurality of state storage memory cells to store programmed values corresponding with the second subset of memory cells having the 0 state, wherein programming the plurality of state storage memory cells further includes programming for each memory cell having the 1 state a 1 in a first state storage memory cell and a 0 in a second state storage memory cell, programming for each memory cell having the 0 state a 1 in a first state storage memory cell and a 0 in a second state storage memory cell, and programming for each memory cell having the X state one of a 1 in a first state storage memory cell and a 1 in a second state storage memory cell and a 0 in a first state storage memory cell and a 0 in a second state storage memory cell.

The RNG data stream may be a binary RNG data stream having 0 and 1 programmed values.

Implementations of random number generation (RNG) using memory cell states may include: comparing a physical parameter of each of a plurality of memory cells of a computing device with a first threshold value of the physical parameter and with a second threshold value of the physical parameter; identifying a relationship of each of the plurality of memory cells to the first threshold value and to the second threshold value; associating a 0 state to a first memory cell of the plurality of memory cells based on the relationship of the physical parameter of the first memory cell to the first threshold value; associating a 1 state to a second memory cell of the plurality of memory cells based on the relationship of the physical parameter of the second memory cell to the second threshold value; associating an X state to a third memory cell of the plurality of memory cells, wherein the physical parameter of the third memory cell is between the first threshold value and the second threshold value; programming a plurality of state storage memory cells to store programmed values corresponding with the first memory cell by storing a 1 in a first state storage memory cell associated with the first memory cell and a 0 in a second state storage memory cell associated with the first memory cell; programming the plurality of state storage memory cells to store programmed values corresponding with the second memory cell by storing a 0 in a first state storage memory cell associated with the second memory cell and a 1 in a second state storage memory cell associated with the second memory cell; programming the plurality of state storage memory cells to store programmed values corresponding with the third memory cell by storing one of a 0 in a first state storage memory cell associated with the third memory cell and a 0 in a second state storage memory cell associated with the third memory cell and a 1 in the first state storage memory cell associated with the third memory cell and a 1 in the second state storage memory cell associated with the third memory cell, and; including one or more of the programmed values of the third memory cell in an RNG data stream.

Implementations of RNG using memory cell states may include one, all, or any of the following:

The plurality of state storage memory cells may be included in one of a static random access memory (SRAM), an SRAM-based ternary content-addressable memory (TCAM), a NAND flash memory, a NOR flash memory, a dynamic random access memory (DRAM), a resistive random access memory (ReRAM), a magnetic random access memory (MRAM), a spin transfer torque MRAM (STT MRAM), an electrically erasable programmable read-only memory (EEPROM), and any combination thereof.

Generating, using the RNG data stream, one of an AES encryption key and an asymmetric encryption key.

The foregoing and other aspects, features, and advantages will be apparent to those artisans of ordinary skill in the art from the DESCRIPTION and DRAWINGS, and from the CLAIMS.

BRIEF DESCRIPTION OF THE DRAWINGS

Implementations will hereinafter be described in conjunction with the appended drawings, where like designations denote like elements, and:

FIG. 1 is a table view listing various PUF function pattern processes that can be generated using various memory types;

FIG. 2 is a chart showing values of a physical parameter for various memory cells in an array and an assignment of the memory cells as having 0 and 1 state values based on the relationship of the physical parameter to a threshold value;

FIG. 3 is a block diagram of two PUF authentication method implementations;

FIG. 4 is a chart showing values of a physical parameter for various memory cells in an array and an assignment of the memory cells as having 0, 1, and X (ternary) state values based on the relationship of the physical parameter to a first and a second threshold values;

FIG. 5 is a flow chart of an implementation of a method of generating a PUF pattern from a memory;

FIG. 6 is a diagram showing the various steps carried out in a method of generating a ternary PUF data stream and a binary PUF data stream;

FIG. 7 is a flow chart of a method implementation of authentication using PUF challenge/response pairs/patterns;

FIG. 8 is a diagram illustrating the various steps carried out in a method of authenticating using a binary PUF data stream and a ternary PUF data stream and a ternary content addressable memory (TCAM);

FIG. 9 is a chart showing values of a physical parameter for various memory cells in an array and an assignment of the memory cells as having 0, 1, X, and BX state values based on the relationship of the physical parameter to a first, second, third, and fourth threshold values;

FIG. 10 is a diagram showing an implementation of a static random access memory (SRAM) and how a PUF pattern implementation can be mapped using the SRAM implementation;

FIG. 11 is a diagram showing an implementation of a ternary content addressable memory (TCAM) and how a PUF pattern implementation can be mapped using the TCAM implementation;

FIG. 12 is a diagram showing an implementation of a flash memory and how a PUF pattern implementation can be mapped using the flash memory implementation;

FIG. 13 is a diagram showing an implementation of the circuity for a dynamic random access memory (DRAM) or a resistive random access memory (ReRAM) and how a PUF pattern implementation can be mapped using such memories;

FIG. 14 is a cross sectional view of a ReRAM implementation;

FIG. 15 is a diagram of the operational process for programming a ReRAM memory cell;

FIG. 16 is a graph showing the cumulative distributions of the on and off resistance of a ReRAM memory implementation;

FIG. 17 is a cumulative probability distribution of the Vset voltage for an array of ReRAM memory cells;

FIG. 18A is a cumulative probability distribution for a ReRAM memory cell with a low Vset voltage;

FIG. 18B is a cumulative probability distribution for a ReRAM memory cell with a high Vset voltage;

FIG. 19 is a graph of the standard deviation of Vset within a ReRAM memory cell in volts;

FIG. 20 is a flow chart of an implementation of a method of generating a random number pattern from a memory;

FIG. 21 is a diagram showing an implementation of a method of generating random number data stream;

FIG. 22 is a block diagram of an implementation of a system that generates random numbers from a memory containing ternary states;

FIG. 23 is a block diagram representatively illustrating asymmetric key encryption techniques that may use random numbers generated by the method illustrated in FIG. 21;

FIG. 24 is a block diagram of an implementation of an authentication method;

FIG. 25 is a block diagram of an implementation of an authentication method;

FIG. 26 is a block diagram of an implementation of an authentication method;

FIG. 27 is a block diagram of an implementation of an authentication method, and;

FIG. 28 is a representative illustration of an embedded authentication device and method.

DESCRIPTION

This disclosure, its aspects and implementations, are not limited to the specific components, assembly procedures or method elements disclosed herein. Many additional components, assembly procedures and/or method elements known in the art consistent with the intended physically unclonable function (PUF) generating systems and related methods will become apparent for use with particular implementations from this disclosure. Accordingly, for example, although particular implementations are disclosed, such implementations and implementing components may comprise any shape, size, style, type, model, version, measurement, concentration, material, quantity, method element, step, and/or the like as is known in the art for such physically unclonable function generating systems and method implementations, and implementing components and methods, consistent with the intended operation and methods.

PUFs form a set of cryptographic primitives used in authentication/cryptographic methods. The underlying authentication mechanism in which PUFs are used is in generating Challenge-Response-Pairs/Patterns (CRP). PUFs that are unique to each device allow an authentication system to challenge a device seeking authentication, receive half of a CRP pair from the device, and then compare the received half with a stored CRP pair to verify whether a match takes place. Where the PUFs take advantage of the natural manufacturing variations unique to the device seeking authentication, a large number of Challenge (i.e. input) Response (i.e. output) pairs can be generated. The generation of CRPs may need to be reproducible, predictable, and easy to recognize during the authentication process for the CRPs to be useful.

In various authentication systems, the challenges are stored in a secure server coupled to the device being prepared for authentication. The device wishes to operate using resources to which access is controlled by the secure server, and so the secure server must approve authentication of the device in order for it to operate. Once generated during the initial portions of the authentication cycle, the PUFs are then used in challenge queries. Authentication is granted by the system when the rate of matching responses between the PUF generated CRPs is high enough above a threshold value. Weak PUFs generally only produce a satisfactory rate of responses far from 100% matching, while with strong PUFs the rate approaches 100%. Other criteria used to assess the quality of a PUF are, by non-limiting example, the size (in bits) of the CRPs, and the robustness of the responses with respect to temperature and voltage variations, electromagnetic interferences, and device aging. When PUFs are used, their nature creates a cryptographic expectation of randomness and uniqueness that should make good PUFs hard to extract and identify for unwelcome users, and easy to implement and use for secure authentication.

FIG. 3 illustrates two implementations of authentication systems that utilize PUFs. With RAM based architecture (upper block of FIG. 3) the PUF keys are extracted from the PUF RAM memory generator and provided to the secure processor of the device seeking to be authenticated by the secure server. The secure processor then performs a comparison of this pattern with a stored PUF key provided for the authentication from the secure server. Content Addressable Memories (CAM) (lower block of FIG. 3) can directly perform the PUF key matching “in situ,” which may further enhance the level of security over the RAM based authentication system. For example, when attacking a RAM based system, hackers will attempt to use bad keys to extract the PUF secret key transferred from the PUF memory to the secure element. However, since the PUF key matching is done directly between the CAM memory and the secure processor, this key extraction method will not work in a CAM based architecture.

In this document, PUFs are derived from analyzing intrinsic manufacturing variations of semiconductor devices that are created during the fabrication of the devices. Non-limiting examples of such variations that alter device characteristics include variations in critical dimensions, doping level(s) of semiconducting materials, threshold voltages, variations in lot-to-lot processing, and variations in wafer-to-wafer processing. These variations make each device unique, and identifiable from every other device, like a device fingerprint or biological DNA.

Conventional examples of PUFs generated using characteristics of semiconductor memories may be found in the following references: the paper by Vatajelu et al., entitled “STT-MRAM-Based PUF Architecture Exploiting Magnetic Tunnel Junction Fabrication-Induced Variability,” ACM Transactions, V. 39 (July 2015); the paper by Prabhu et al., entitled “Extracting Device Fingerprints from Flash Memory by Exploiting Physical Variations,” 4th International Conference on Trust and Trustworthy Computing, June 2011; the paper by Yamamoto et al., entitled “Variety Enhancement of PUF Responses Using the Locations of Random Outputting RS Latches,” J. Cryptogr. Eng. V. 3, p. 192-211 (2013); the paper by Yamamoto et al., entitled “Uniqueness Enhancement of PUF Responses Based on the Locations of Random Outputting RS Latches,” Cryptographic Hardware and Embedded Systems—CHES 2011—Lecture Notes in Computer Science, V. 6917, p. 390-406 (2011); U.S. Pat. No. 5,434,917 to Naccache et al., entitled “Unforgeable identification device, identification device reader and method of identification,” issued Jul. 18, 1995; U.S. Pat. No. 8,300,450 to Christensen et al., entitled “Implementing physically unclonable function (PUF) utilizing EDRAM memory cell capacitance variation,” issued Oct. 30, 2012; and U.S. Patent Publication No. 20150071432 to Zhu et al., entitled “Physically unclonable function based on resistivity of magnetoresistive random-access memory magnetic tunnel junctions,” filed Nov. 11, 2013; the disclosures of each of which are hereby incorporated entirely herein by reference.

Referring to FIG. 1, a table is shown that describes in brief summary form various methods for generating a PUF from various memory array structures. FIG. 2 is a chart showing values of a physical parameter for various memory cells in an array and an assignment of the memory cells as having 0 and 1 state values based on the relationship of the physical parameter to a threshold value. FIG. 2 illustrates how, for a particular physical parameter, memory technologies have a tipping points in their programming conditions, such that the likelihood of programming “0” s is the same as programming “1” s. Small manufacturing variations at the cell level (depending on the technology, see FIG. 1) can generate either “0” s or “1”s under various operating conditions. When the manufacturing variations that generate either “0”s or “1”s are tracked over a large number of cells this data can be used to create a digital signature exploitable as part of a PUF. FIG. 2 shows a threshold value, and it is to be expected that the cells falling close to the threshold value point are equally statistically likely to flip from 0 to 1 or 1 to 0 during startup and/or programming cycles. Furthermore, over time, cells with physical parameters close to the threshold value are likely to drift in different directions (i.e., in their likelihood of being 0 or 1) after being subject to aging, temperature and voltage changes, or electromagnetic interferences.

One way to create PUFs used in CRPs for various memory devices is to generate the PUFs (for use as challenges) during the power up cycles of the devices, then temporarily store them in the same memory that was used to generate the challenge or in another secure embedded memory coupled with the memory. During use, the responses to the generated and temporarily stored challenges are provided to the secure server during the authentication process using a secure processor in the device seeking authentication. All electronics-based cryptographic solutions have intrinsic weaknesses that can potentially be exploited by crypto-analysts using methods such as Differential Power Analysis (DPA), or electromagnetic probes. This is because processing “0”s and “1”s tends to generate different electric currents that are particularly visible during programming and reading cycles of a memory. PUFs are more difficult to detect using these techniques, however, because they do not involve ongoing programming and reading steps during operation—the only time a PUF is stored, read, or processed is during power up or at the time an authentication is attempted. Because these are not regular events, it will be more difficult for such cryptoanalytic methods to be useful absent real-time knowledge of what the authentication system is doing at a point in time.

To reduce exposure to side channel attacks using techniques such as differential power analysis, system implementations disclosed herein pair “0”s and “1”s together to create a “0, 1” pair as a “0”, and a “1, 0” as a “1”. This is because logic processors consume the same current to process a “0, 1”, as a “1, 0”. The states “1, 1”, and “0, 0” are byproducts of logic architecture, and can be used in various implementations for processing using ternary logic. Ternary logic has been used in the process of dispatching Internet Protocol (IP) packets through routers. Ternary Content Addressable Memories (TCAMs) dispatch the packets where the ternary state also referred as “no cares” is formed by blanking part of the IP addresses. It has also been reported that these additional states can be used for cryptographic purposes. The use of a PUF with ternary values (0/1/random) increases the entropy of the PUF, and in some conventional systems, latches and additional circuitry were added to sort out random memory cells, and store the ternary states of the PUF. Assuming that a PUF has “n” challenges, the number of possible states (i.e. the entropy) of a binary PUF is 2^(n) while the entropy of a ternary PUF could reach 3^(n).

If a PUF is based on data collected from a memory that contains a high enough ratio of marginal cells close to the threshold value in FIG. 2, a weak PUF will result. Error detection and error correction algorithms can be used to counteract this to enhance the strength of PUFs. However, systems that minimize the number of marginal cells used to generate the data used in a PUF will fundamentally result in a stronger PUF. As illustrated in FIG. 1, each memory type used for PUF generation uses different physical principles. When “0”s and “1”s are created based on a single arbitrary threshold as illustrated in FIG. 2, the (marginal) cells located close to the transition value are unstable, and can switch back and forth between 0 and 1 over time, subject to thermal variations, aging, or other electrical noise interactions. The ratio of marginal cells that are not reliable for the generation of a strong PUF pattern is typically in the about 5 to about 20% range based on conventional manufacturing techniques. Since PUFs disclosed herein leverage the small micro-manufacturing variations cell to cell, these unpredictable and unstable patterns will weaken the strength of the PUFs.

FIG. 4 is a chart showing values of a physical parameter for various memory cells in an array and an assignment of the memory cells as having 0, 1, and X (ternary) state values based on the relationship of the physical parameter to first and second threshold values. FIG. 4 also illustrates a technique for using ternary values to handle marginal cells. This method begins by identifying three types of cells in the memory being analyzed: the ones that are solidly a “0” far away from the transition point between the first and second threshold value, the ones that are solidly a “1” also far away from the transition point, with remaining ones between the first and second threshold values being given a ternary state value “X”. The objective of the method is to increase the probability of a solid bit, 0 or 1, to remain stable and predictable over the life time of the memory. In various implementations, the first and second threshold values may be set to enable PUF authentication failure rates typically below the part per million range as is achieved in commercially available memory product manufacturing process. The cells to be blanked by an “X” state include the cells that are too close to the transition point based on a particular physical parameter value associated with the cell. In various implementations, the cells to be blanked by the X state value can also include cells that are not reliable. Methods to test the quality of the cells are known, can be quite slow, and typically last a few seconds. For example, an existing BIST (Built In Self-Test) module/process could be implemented as a testing system and the data from the test used to identify marginal cells along with information about the particular physical parameter(s) being used to for comparison with first and second thresholds. By identifying the marginal/transition point cells, and blanking them with an “X” state, the method increases the quality of the data stream of the remaining “0”s and “1”s that are generated by the memory used for the PUF values. Unlike some conventional systems, there is no need for external circuitry to store the “X” state, as the memory used to generate the PUF itself can store the three states (0, 1, X), as described herein.

Various methods of identifying, storing, and using ternary (and quaternary) states in memory cells for use in a PUF are possible using the principles disclosed in this document. Those system and method implementations disclosed herein are for the non-limiting exemplary purposes of this disclosure and those of ordinary skill will readily appreciate how to apply the principles disclosed herein to other system and method implementations.

Referring to FIG. 5, an implementation of a method of generating a PUF pattern (challenge/response pair) is illustrated. Initially, the memory is configured. The memory is segmented by pairs of rows. The cells of the first row of each pair, referred as the “active row”, are the ones in which characterization is carried for generating PUF patterns, and also, in some implementations, where the resulting PUF patterns used for challenges are stored. The cells of the second row of each pair, referred as the “companion row”, are the cells where complementary information (state values, categories) is stored to describe the three elementary states, 0, 1, and the third state “X”. In some implementations to be discussed hereafter, like the systems illustrated in FIG. 13, it is also possible to segment the memory by pairs of columns (active and companion) rather than by pairs of rows where an active column, and a companion column is likewise included for each pair.

The method also includes using the system to measure the physical parameters of the cells in the active row. In some implementations, this information may already be stored in the memory or in another memory coupled to the system and may be retrieved rather than being directly measured, depending on the type of physical parameter being used. This process involves making a determination of the status of all cells of the active rows, i.e. that each cell is, based on its read state and how close a physical parameter(s) of the cell is to first and second threshold values (and third and fourth threshold values) for that parameter(s), a “0”, a “1” or a “X” (and BX where third and fourth threshold values are used as described hereafter). The sorting processing may be lengthy, depending upon the method used to evaluate the status of the cells and/or the physical parameters of the cells. In some implementations, fewer than all of the cells in the active rows could be evaluated.

The method includes using the system to write/program the solid 1 and 0 cell values to memory. These values may be written to the same memory being analyzed or may be written to an external memory in various implementations. Where external memories are used, the values may be themselves encrypted. Since the method creates a data stream that includes only the solid 1 and solid 0 values, only “0”s and “1”s need to be stored in the memory cells. Accordingly, any memory technology can be used for storage, even if it is structurally different from the one being analyzed. When a particular cell of an active row has been characterized as a solid “0”, a “0” is programmed in this cell, and a “1” is programmed in the companion cell. In a similar way, a solid “1” is programmed as “1” in the active row, and a “0” in the companion row. All remaining cells that do not yield solid bits are programmed with a ternary state, an “X”, with both bits in the active row and the companion row being identical, either a “0, 0” or a “1, 1”. In various implementations of the method, it is possible to program only “0, 0”s, only “1, 1”s, and/or to alternate between the two.

Referring to FIG. 6, with the mapped ternary state data, the method includes generating a PUF data stream (PUF Raw Data Stream) using the 0, 1, and X values stored in the memory. After the programming operation, the basic 3 states that may be kept in the memory for the purpose of PUF pattern generations are “0”s (the pair “0, 1”), “1”s (the pair “1, 0”), and, in some implementations, the “X”s (either the pair “0, 0”, or the pair “1, 1”). As a result of this process, two types of PUF patterns can be generated by the system. The first is a PUF binary data stream (Output 1). The mapping of the “X”s is extracted and kept stored in the memory of the device being analyzed for use in future authentication, while the data stream transmitted to the secure server is the pure binary 1 and 0 pattern of the solid 1s and 0s. Because these binary values are based on solid 1s and 0s and may include nearly no marginal cell values, this data stream may be solid and strong, and ready for use to provide clear authentication of the device being analyzed. The second PUF data stream that can be generated is a PUF ternary data stream. If the secure process can handle ternary data streams, such a data stream would offer additional security features above a binary data stream as discussed previously, as the entropy of the PUF pattern is increased accordingly.

Referring to FIG. 7, a flow chart of an implementation of a method of authenticating a device using a physically unclonable function is illustrated. The method may include preparing the PUF reference pattern after powering up the memory being analyzed. If the memories that generate the PUF patterns are non-volatile, these memories can be erased when the device is powered up. During the power-up cycle, the PUF reference pattern is generated using any method disclosed in this document and then stored in the secure server. Following generation of the pattern, the PUF reference pattern (response pattern) generated by the PUF memory, and the one brought by the secure server received from the device seeking authentication (the PUF comparison pattern, challenge pattern) are compared for the purpose of testing the level of matching between both patterns. This matching can be done at the binary level, or at a ternary level. Due to the strong quality of the binary data stream it is expected that the authentication signal resulting from the matching (or not) of the PUF reference pattern from the server with the PUF comparison pattern provided by the device will be strong. In case of a mismatch, the likelihood that the cause of the mismatch is coming from the poor quality of the PUF patterns should be low and that the mismatch is instead an intrusion attempt. The consequences of a mismatch are set out in FIG. 7. As can be seen, one of the options if the authentication is unclear is for the device to restart the authentication sequence, which could include generating the raw PUF comparison and or reference pattern again or merely restarting the comparison process between the two patterns again.

Referring to FIG. 8, illustrates how the authentication can be done using a TCAM. As previously described herein, the authentication can be done by extracting the PUF reference pattern from a RAM for data matching, or by comparing the PUF reference pattern provided by the secure server directly in a CAM. In the authentication process illustrated in FIG. 8, the ternary data streams are transferred directly in a TCAM PUF memory for data matching. Such authentication process may be difficult to break using side channel attacks such as DPAs as discussed previously.

Various system and method implementations may utilize methods of enhancing the level of cryptographic security of the PUF pattern generated. In a first method implementation, the entropy of the PUF is increased. If, for example, the PUF has 128 bits of which 16 are potentially unstable, the level of certainty of a matching could fluctuate between 87% (112/128) and 100%. Conventional systems that use ternary state (0, 1, random) potentially increase the entropy from 2¹²⁸ to 3¹²⁸ (3¹²⁸≈2^((128×1.58))) however conventional systems require the overall system to comprehend and handle ternary logic to achieve this. The stability of the third states, the random ones, is not necessarily as good as the stability of the “0”s and the “1”s, so an entropy of 3^(n) is only a best case, and only assuming the three states are equivalent, which is not practically the case.

A first method implementation involves setting aside an increased portion of a memory used to generate PUF patterns for use in challenges. In various implementations, this can be done in such a way that the size of the active PUF pattern can be kept at a preferred/predetermined level after blanking. For example 150 bits can be set aside to leave 128 clean bits after the blanking of 32 “X” bits. The objective is to raise the probability of a matching signal during authentication to close to 100%. It is expected that if the screening process is appropriate, the 128 bits left are predictable, reproducible, and fully authenticable. The important criteria is the stability of the “1”s and “0”s, not the stability of the “X”s because they are blanked. The “X”s can then actually be tested as “1”s or “0”s and alternate between these states without impacting the authentication cycle. The logic circuitry supporting this PUF memory outside the direct control circuitry can be purely binary. This method implementation allows the reuse of existing system solutions including the secure server, cryptographic methods, and operating software to carry out the binary operations as disclosed herein.

Referring to FIG. 9, a chart is illustrated that shows values of a physical parameter for various memory cells in an array and an assignment of the memory cells as having 0, 1, X, and BX state values based on the relationship of the physical parameter to a first, second, third, and fourth threshold values. A second method implementation of improving the entropy of the PUF pattern involves taking advantage of the quaternary states created by the logic of the method implementations of generating PUF patterns disclosed herein and illustrated in FIG. 9. This logic is quaternary with four distinct states “0, 1”, “1, 0”, “1, 1” and “0, 0”. It is possible in various implementations to take advantage of this quaternary system, and to differentiate the cells that are consistently in the middle of the physical distribution as illustrated in FIG. 9, versus the ones that are in a buffer zone. The cells that are in the middle zone between the transitions points Ma and Mb can be referred as the real/solid “X”s, and be programmed with the state “0, 0” or “1,1”. These cells located in the buffer zones can be referred as “BX” between the third threshold (Ma) 2 and the first threshold and between the fourth threshold (Mb) 4 and the 2^(nd) threshold. These cells can be programmed with the state “1, 1” or “0,0” depending on the implementation. In this case, the expectation is that the states “0”s, “1”s and “X”s are solid, predictable, reproducible, and authenticable while the “BX” states become the ones that are used to blank part of the memory. Back to the previous example, the size of the set aside memory used to generate the PUF can be increased to 256 bits to leave 128 bits that are solidly “0”s, “1”s, or “X”s, with the balance 128 bits to be blanked as “BX”. Such a method implementation is capable of generating a strong ternary PUF with an entropy of 3^(n) (3¹²⁸ for this PUF pattern). Furthermore, the use of the quaternary state BX can act as an error correction method that enhances the quality of the PUF generated pattern, and also subsequent operations such as pattern matching and authentication. Such method implementations could supplement or partially replace other ECC methods and simplify pattern processing operations. The ternary state X can similarly be used as an error correction method.

Other implementations of methods for increasing the cryptographic strength of the PUF patterns include a method of programming “0”s and “1”s to reduce side channel attacks. In the method, the “0”s are programmed as “0, 1”s, and the “1”s as “1, 0”s, so the measurements of the electric currents generated during authentication cannot differentiate the “0”s and the “1”s. If the ratio of “X”s is kept constant for all PUF patterns generated using the methods, side channel attacks based on power analysis such as DPA cannot easily extract the patterns during authentication, as the current generated by all the patterns will look essentially the same.

In various methods, error detection and error correction methods may be used in conjunction with the methods used to generate PUF patterns and/or with the methods of authenticating PUF patterns. The memory generating PUF patterns can benefit from error detection/error correction when done prior to the PUF pattern generation to improve the quality of the patterns. Error detection/correction can also be done during the pattern generation cycles, or subsequent operations such as matching or authentication cycles. The usage of ternary states or quaternary states to blank the bad cells can also act as an effective error correction step, further enhancing the strength of the PUF, by reducing the need to implement error management systems that can slow down operations, and potentially facilitate side channel attacks.

Additional techniques for encrypting the stored PUF reference pattern may be used in various method implementations. For example, additional X state values obtained from a cryptographic key or pin code may be inserted into the memory array to distort the stored pattern. These additional X state values may be then subtracted during the authentication cycle to restore the original pattern. Many other algorithms for use in encrypting/decrypting the stored PUF pattern may be used in other implementations.

Method and system implementations disclosed herein may use any of a wide variety of memory types. Some non-limiting examples are disclosed herein in the following sections.

SRAM and TCAM Memories:

Referring to FIG. 10, during power on cycles, the 6T-cells of the SRAMs randomly flip as ones or zeros due to small variations in the micro-manufacturing of the memory, a feature that can be used to generate PUF patterns. As described herein, in various method implementations, the active row of each pair of rows of the memory used for characterization is used for the purpose of generation of “0”s and “1”s, while the companion row is programmed to define the three states “0”, “1”, and “X”. In the case of “0”s and “1”s, the companion rows are used to store the opposite bits of the one stored in the active rows as previously described. In case of “X”s, identical bits are stored in the active rows and in the companion row. FIG. 10 shows an example where 1, X, 0, 0 is stored in the first pairs of two rows (FIG. 10 contains a typo in the mapping of the PUF which should read “1 X 0 0” to match the SRAM Array but instead reads “1 X 0 1”), and 0, 1, X, X in the second pairs of two rows. In this embodiment (applicable to any commercial SRAM technology) the total number of cells needed to store a PUF pattern with n bits is 2*n.

Referring to FIG. 11, in a similar way, SRAM based TCAMs with 6T cells can generate PUF patterns as well. One side of the TCAM cells, the one used to store reference patterns, can be foundational for the generation and storage of PUF patterns. During power up cycles it can be determined which cells of the array consistently flip to a “0”, a “1”, or should be blanked as an “X”. The other side of each TCAM cell, the one used to load the input (PUF comparison) patterns before in situ matching/comparing, can be used to store the PUF reference pattern provided by the secure server. Both patterns can then be compared as part of the authentication process. FIG. 11 is an example of an embodiment of the method using a TCAM system. The data search (1, X, 0, 1, X) is stored in the first row of TCAM cells, and is compared at once with the input pattern (1, X, 0, 1, X). In this way, the authentication process operates faster, and becomes less susceptible to side channel attacks when TCAM cells are used.

NAND Flash Memory:

Referring to FIG. 12, an example of an implementation of a method of forming PUF patterns using floating gate NAND flash is illustrated. One of several ways to generate PUF patterns with flash memories is to perform fixed time programming of the floating gates, and to stop programming at the tipping point between the “0”s and the “1”s where the probability to have each state is around 50%, which leaves the final state subject to manufacturing variations. The programing of a “1” from a “0” state is done by trapping a negative charge within the floating gate. The strong “1”s are programmed with the pair “1, 0” on the active/companion rows, the strong “0”s with the pair “0, 1”, and the “X”s with the same bit on the active row and on the companion row (1, 1, or 0, 0). The input patterns for authentication are brought through the word lines in the form of input voltage: “1”s have a voltage on the word line higher than the threshold voltage required to make the flash transistor conductive; “0”s have a voltage lower than the threshold voltage of the flash transistors that have been charged with electric negative charges (these transistors were programmed as a “1”), but the voltage is high enough to make the un-charged transistors (the ones programmed as “0”) conductive.

In various method implementations, the match or not of an entire bit line can be tested at once; the impedance of the bit line is low only when the information stored in the cells matches with the electrical signal entered through the word lines. FIG. 12 illustrates that the pattern (1, 0, 0, X) is entering through the word lines where it has been stored in the first bit line. A single mismatch in the NAND chain triggers a high impedance state of the chain. Such an implementation of the method creates a very dense implementation of a PUF with ternary states using CAM authentication. The size of the memory array in such an implementation will be only twice the size of the PUF pattern. Other floating gate or charge trapping memory technologies can also be used with such a PUF pattern method implementation, and be similarly described by a block diagram similar to the one illustrated in FIG. 12. These include, by non-limiting example, NOR Flash memories and EEPROMs.

DRAM and ReRAM Memories:

Referring to FIG. 13, DRAM cells contain capacitors that selectively trap an electric charge to differentiate the 1s (charged) from the 0s (uncharged). One method implementation for generating a PUF pattern using a DRAM cell is to charge all the cells, disconnect the refresh cycle, and let the natural leakages drain the DRAM cells during a fixed amount of time that is at the tipping point between the zeros and the ones; the probability of getting a “0” or a “1” should be close to 50% at this tipping point. The cells that then are programmed as “1”s are the ones with enough electric charge left to be tested as a solid “1”, the “0”s are the ones with the lowest electric charges left, the “X”s are the ones in the buffer zone (between the various thresholds as discussed herein). Such a mapping can be used with any method implementation for generating PUF patterns disclosed in this document

The resistivity of a Resistive Random Access Memory (ReRAM) cell is designed to be high. During programming cycles, the resistivity of the ReRAM cells typically drops several orders of magnitude. One way to generate a PUF pattern is to record the natural variations in the resistivity of the cells after programming; the higher resistivity values can be programmed as “1”s, the rest as “0”s or “X”s and used according to the methods disclosed herein.

Referring to FIG. 13, implementations of a method of generating PUF patterns and of authenticating PUF patterns using DRAM or ReRAM memories is illustrated. The first columns, the active columns, are the ones where “0”s and “1”s are generated, which can become the PUF patterns (challenges). The third columns, the companion columns, are the ones where the additional bits are stored to differentiate the “0”s, “1”s, and “X”s. The second and fourth column are available to enter the reference pattern from the secure server for the authentication cycle. All patterns in word line 1 can be checked for matching at once. Word Line −1 contains the pattern (1, X, 0, 1) and an identical pattern has been programmed for authentication. The logic function suggested in FIG. 13 for performing authentication is: [{a XOR b} OR {a′ XOR b′}]. Other logic functions could also be used in various method implementations such as [{a XOR b} AND {a′ XOR b′}]. Use of the methods for DRAM or ReRAM memories produces a dense implementation, as the arrays for storing and managing a PUF pattern are only 4× the size of the effective PUF pattern to be stored.

Spin Torque Transfer-Magnet Random Access Memories (STT-MRAMS) and other MRAMS can be considered a subset of ReRAMs in terms of their mapping and method applications. The structure and methods disclosed in FIG. 13 would also apply to these magnetic memory technologies.

In particular system implementations, ReRAM memories may be used in both RAM and CAM arrangements. The particular physical parameter that is used to evaluate the memory cells is the resistivity of Vset of the cell. High values of Vset are associated with 1's, low value of Vset are associated with 0s, and those values in between threshold values of Vset are blanked as Xs. For a RAM architecture design, an active column of memory cells is selected which is tested and a companion column of memory cells is used to store the resulting 0s, 1s, and Xs. As in the various method implementations disclosed herein, the companion column may store a 0 when a 1 cell is identified, a 1 when a 0 cell is identified, and either a 0 or 1 when a X cell is identified. The active column is used to store the other 1, 0, or 0 and 1 paired value, respectively.

In a CAM architecture, four columns are required to test all of the states, a first and third column as the active and companion columns for storing the PUF reference patterns. The second and fourth columns are used to store the PUF response patterns for analysis during authentication. As was previously described as illustrated in FIG. 13, in a CAM architecture, all PUF response patterns/PUF reference pattern pairs in word line 1 can be checked for matching at once according to the logic function [{a XOR b} OR {a′ XOR b′ }]. Both the RAM and CAM architectures used in these system implementations use standard ReRAM arrays and state machines.

An experiment was run to test whether Vset variations in a ReRAM array of memory cells could be used to generate reliable ternary states to create challenge-response-pairs that would allow authentication cycles to take place with sufficiently low error rates to be useful. This experiment is detailed in the subsequent sections of this document.

Referring to FIG. 14, in order to model realistic ReRAM PUF pattern generation, Cu/TaO_(x)/Pt resistive devices were fabricated in a crossbar array on a thermally oxidized Si wafer 6 with a layer 8 of SiO₂ 800 nm thick. Such a design may be found in the paper by Gargi Ghosh and Marius Orlowski, “Write and Erase Threshold Voltage Interdependence in Resistive Switching Memory Cells,” IEEE Transactions on Electron Devices V. 62, No. 9, p. 2850-2857 (2015), the disclosure of which is hereby incorporated entirely herein by reference. Both metal electrodes and solid electrolyte were deposited by E-beam evaporation and patterned by lift-off techniques. The oxygen-deficient TaO_(x) layer 10, 16 nm thick, was deposited by evaporating TaO_(x) pellets without O₂ injection to the evaporation chamber. In the memory cell design, the top Cu electrode 12, 150 nm thick, runs perpendicularly to the bottom Pt electrode 14, which was 60 nm thick and included titanium. The width of the metal lines varied between 1 micron and 35 microns.

A single Cu/TaO_(x)/Pt switch relies on electrochemical formation and rupture of a conductive filament (CF) bridging the TaO_(x) dielectric 10 between the active Cu electrode 12 and the inert Pt electrode 14. Referring to FIG. 15, there is a minimum Vset voltage at which the CF is being formed. When the voltage applied to the Cu electrode 12 is pulsed or swept at a positive voltage, the current remains substantially zero until a critical voltage Vset is reached, at which a Cu CF is formed that connects the Cu electrode 12 and Pt electrode 14. The memory cell then switches from a high resistive state (HRS) characterized by an Roff of 1-900 megaohms to a low resistive state (LRS) characterized by an Ron of 70-6000 ohms, yielding a ratio of Roff/Ron of approximately 10³-10⁷. When a negative voltage is applied to the LRS state, the CF ruptures at a critical voltage of Vreset and the cell switches from the LRS to the FIRS state. The rupture of the CF is triggered by a critical current Ireset=Vreset/Ron. Therefore, to ensure a successful set operation to logic state 1, the magnitude of the applied maximum voltage must be slightly larger than the magnitude of the Vset voltage for the particular memory cell. Similarly, programming a logic 0 requires a reset maximum voltage slightly larger in magnitude than Vreset for a particular cell.

The cell's switching parameters (Vset, Vreset, Ron, and Roff) are all subject to statistical variations. The variability of cell parameters degrades memory operation margins and the functional array design; however, the variability lends itself to be used in security applications for use in PUF pattern generation. ReRAM may be very robust against physical attacks because the variations of the characteristic parameters (Vset, Vreset, Ron, and Roff) come from structural material properties and are the result of atomic level variation. Furthermore, the ReRAM variability is inherent not only from manufacturing variations, but also in the electro-chemical ionic switch mechanisms of the ReRAM device itself. A ReRAM device cannot be probed by invasive techniques as the atomic changes of the defect densities of the device during operation are hardly visible, even under high resolution transmission electron microscopy. ReRAM is also less sensitive to side-channel attacks due to the lower power characteristics during read cycles, as well as attacks based on photon emission analysis. ReRAM does not emit photons like hot carriers in MOSFET transistors in SRAM or in a floating gate MOSFET cell. ReRAM also may have intrinsically higher density, faster access speed, and better energy efficiency than other conventional memory technologies.

Referring to FIG. 16, a cumulative probability distribution of the Ron and Roff resistances of the ReRAM samples used in the experiment is illustrated. Either or both distributions could be used as a physical parameter for use in PUF pattern generation. The Roff distribution has the advantage that it has larger variation, and also, it can minimize the parasitic voltage drop outside the active structure. Preliminary data indicated that the resistance shift under temperature changes from 0 C to 85 C was less than 10% for both Ron and Roff.

Referring to FIG. 17, the cumulative probability distribution for the Vset parameter for the entire sample ReRAM array of 10,000 memory cells is illustrated. The variations of Vset may be used for PUF generation. As illustrated, the mean of this distribution μ=2.1 V indicated by the dash line, and the standard deviation is σstd=0.545 V. In FIG. 17, there are two lines (first and second threshold values) at a distance of α*σstd from the mean, where a is a PUF design parameter. This voltage dependent switching probability becomes the source of the randomness used for the generation of the experimental PUF patterns. During the experiment, all the cells in the ReRAM memory array were first set to the HRS. Then, by biasing the memory cells at Vset=μ, every cell then was given an equal opportunity to be characterized as a 0 or a 1. In this approach, the mean μ and the standard deviation σstd are used to create two dividers (first and second threshold values) to associate with the three types/states of the memory cells.

During the generation of a PUF reference pattern, the cells were classified as 0, 1, or X depending on whether they fell below the first threshold μ−α*σstd, above the second threshold μ+α*σstd, or between the first and second threshold values, respectively. Those cells with a 0 state value below a minimum Vset (0.8V) were kept in the LRS on the active columns while the companion columns were programed as HRS (1). The cells with a 1 state value above a maximum Vset (3.4 V) are programmed as HRS (1) while the companion columns are programmed LRS(0). Those cells with an X state were programmed to the same state as the corresponding cell in the companion column (LRS/LRS or HRS/HRS). The dimensionless parameter a is used to analyze the statistical model that describes the populations of 0, 1, and X memory cells in the experiment as well as the error rate of a potential challenge response pair. When α=0, the population of Xs is zero and the population of 1 and 0 cells is equal. When α>1, more than 60% of the cells will be Xs. It can also be seen than any α≠0 may somewhat guard against undesired bit-flips and lower the mismatch rates for challenge response pairs. The larger a is, the larger the safety margin is against bit-flips, and the lower the CRP error rate is expected to be. For a large enough a, any statistically reasonable bit flip will be confined to the population of Xs, thus leaving the 0 and 1 populations stable and predictable. In such implementations, this may also guard against environmental factors (i.e., temperature variation) or interferences (i.e., electromagnetic). Accordingly, a can be used to strengthen the stability and reduce the error rate of the PUF patterns at the expense of blanking a higher proportion of the cells with an X state value.

The PUF reference patterns were generated using the ReRAM memory array using the methods disclosed in this document, and using the Vset parameter as the physical parameter and the first and second threshold values disclosed herein. The binary PUF data stream was stored, keeping only 0s and 1s in the secure server with the X's remaining in the ReRAM memory array for use in further authentication. The PUF comparison patterns were generated using the ReRAM array using looser criteria than the reference patterns and stored in the secure server. The PUF comparison patterns were created by testing only the 0 and 1 memory cells and ignoring the X memory cells. The testing to generate the PUF comparison patterns was done using a single threshold value of 2.1 V, where an error would only occur if a 0 memory cell previously tested at the value of the second threshold tested with a Vset above 2.1 or a 1 memory cell tested with a Vset below 2.1. The PUF comparison pattern was stored back in the memory array along with the un-tested X. During authentication, all binary PUF reference and PUF comparison pattern pairs (CRPs) are tested, comparing the patterns generated by the memory array (PUF comparison patterns) against the previously generated patterns from the secure server (PUF reference patterns). An acceptable design point for the PUF patterns is where the cumulative variation in Vset remains within the buffer zones, allowing the PUF comparison patterns and PUF reference pattern pairs to not vary thereby yielding a low CRP error rate.

During the experiment, the robustness of the PUF pattern generation method and the CRP error rate was analyzed using the Vset distribution for several individual ReRAM cells. Referring to FIG. 18A, a cell with a low Vset value (Vset≈1 V) and referring to FIG. 18B, a cell with a high Vset value (Vset≈2.5 V) were selected from the distribution of memory cells in the array. Both cells were subjected to repeated reset and set operations under the same conditions. FIGS. 18A and B show the cumulative probability distributions of the Vset values for each cell. Vset distribution for the low Vset cell is centered around 1 V and its standard variation σstd=0.084 V is smaller than the overall variation of Vset σstd=0.545 V of the array. For the high Vset cell, the distribution is centered around 2.52 V and the σstd=0.158 V, also smaller than the array variation. From the physics of the ReRAM cell, it would be expected that a cell that requires high electric field (i.e., high Vset) will display larger variation than a cell that switches at lower electric fields (low Vset). The standard deviations for the single cells will influence the choice of PUF pattern design parameters. Based on the experimental results, the variation of each cell is shown in FIG. 19 as a function of the average Vset of these individual cells, which shows the within cell standard deviation versus the average Vset.

Tables 1 and 2 present a statistical analysis of the experimental data for varying a values, from 0.5 to 2.0 while the single threshold used to generate the responses varies from 1.8 V to 2.1 V. The analysis assumed normal distributions.

TABLE 1 Max Mean Min Mean % ασ % of for 0s for 0s % of for 1s for 1s of α (V) 0s (V) σ0 μ0 1s (V) σ1 μ1 Xs 0.5 0.27 37.5 1.83 0.106 1.62 37.5 2.37 0.162 2.58 25 1 0.54 16 1.56 0.098 1.34 16 2.64 0.172 2.86 68 1.5 0.81 6.5 1.29 0.086 1.10 6.5 2.91 0.182 3.10 87 2 1.08 2 1.02 0.076 0.84 2 3.18 0.194 3.36 94

TABLE 2 Error rate Error rate Error rate Error rate Error rate Error rate 0 read as 1 0 read as 1 0 read as 1 1 read as 0 1 read as 0 1 read as 0 % of tipping @ tipping @ tipping @ % of tipping @ tipping @ tipping @ % of α 0s 2.1 V 1.9 V 1.8 V 1s 2.1 V 1.9 V 1.8 V Xs 0.5 37.5 650 ppm 80,000 ppm 5% 37.5 35,000 ppm 4,500 ppm 200 ppm 25 1 16 0    8 ppm 1000 ppm 16   1000 ppm    8 ppm  0.5 ppm 68 1.5 6.5 0 0 0 6.5    75 ppm    0.3 ppm 0 87 2 2 0 0 0 2    0.3 ppm 0 0 94

The impact of the error rates in Table 2 on the authentication cycle of a PUF data stream of N bits can be calculated using the Poisson equation. If P(n) is the probability to have n failures over N bits, p is the probability to have one CRP mismatch due to errors as set forth in P(n)=λ^(n)/n! e^(−λ) where λ=pN. Selecting the design point as α=1 with a threshold of 1.9 volts yields an error rate of p=8 ppm. Assuming N=128, P(0)=99.2%; P(1)=0.794%, P(2)=30 ppm; and P(3)≈0. Given these calculations, it is clear that the probability that at least 126 bits of the PUF comparison pattern match the PUF reference pattern during the authentication cycle over 128 CRP candidate pairs is almost certain. About 68% of the memory cells are blanked with X state values and the remainder are used for PUF pattern generation. Based on this information, to generate a PUF of 128 bits, the memory array involved needs to be in the 1000 bit range and 50% of the cells will be used as companion cells.

The experimental data above was also used to model a ternary PUF data stream using the method implementations disclosed herein. In this case, third and fourth threshold values were determined to determine additional memory cells to be assigned BX state values. The PUF reference patterns were generated using the following threshold values: for 0s, the first threshold was 1.29 V, which statistically represents 6.5% of the cells with a mean μ=1.1 V and σ=0.086 V. For Xs, the third threshold was 1.9 V and the fourth threshold was 2.0 V which included 7.5% of the cells with a mean μ=1.95 V and a σ=1.3 V. For 1s, the second threshold is set to 2.91 V which includes 6.5% of the cells with a mean μ=3.1V and a σ=0.186 V. The remainder of the cells, about 80%, were assigned the BX state value and blanked. The PUF comparison patterns were generated using the transition point between 0s and Xs at 1.45 V and the transition point between Xs and 1s at 2.45 V. With these values, the calculated error rates for the CRPs was as follows: 0 read as an X=2,000 ppm; X read as a 0/1=8,000 ppm, and 1 read as an X=10,000 ppm. The worst case is 1s reading as Xs. This error rate is higher than what is expected from binary PUF CRP data, however considering that the entropy of the CRPs will be 3^(N) rather than 2^(N) this may be a good trade off Using the Poisson equation with N=128 and p=10,000 ppm (1%), the probability of having n errors P(n) is as follows: P(7)=300 ppm; P(8)=50 ppm; P(9)=7 ppm; P(10)<1 ppm.

Accordingly, the probability to have 118 CRPs of the 128 match is almost certain. The entropy that results from using the ternary PUF data stream 3¹¹⁸=2*10⁵⁶ is still greater than 2¹²⁸=3.5*10³⁸. Given this, the experimental data indicates that with the judicious selection of error rate threshold values, ternary PUF data streams could be successfully implemented.

In addition to the concept of using PUFs for authentication, the PUF generating methods and systems disclosed herein may also be used in cryptographic operations to generate random numbers to be used in encoding data being transmitted between devices. This is done by using the X cells to generate random numbers to be used in encrypting data. One method implementation is carried out by programming in advance the entire ReRAM arrays with 0s and 1s based on Vset determination. The cells that are close to the transition point are kept for random number generation, while the cells that are solidly 0s, 1s, and defective cells are simply blanked with an X. Table 3 summarizes a statistical analysis of such a method implementation using the data presented in FIG. 17. With α=0.05 representing 4% of the cells, the ratio I/O for a single cell is expected to be in the 46% to 54% range for 50% of the cells and 54% to 46% for the other half, indicating that the likelihood these cells will randomly be 1 or 0 is reasonably close to 50/50.

TABLE 3 Prob. Prob. Xs read Flip Xs read Flip ασ % of % of % of as a 0 for Xs as a 1 for α (V) 0s 1s Xs Min μ 0 > 1 Max μ Xs 1 > 0 0 0 50 50 0 N/A N/A N/A N/A N/A N/A 0.05 0.027 48 48 4 2.072 2.087 46% 2.127 2.113 46% 0.1 0.054 46 46 8 2.046 2.076 43% 2.154 2.124 43% 0.15 0.081 44 44 12 2.019 2.060 38% 2.181 2.140 38%

Given these values, it would take about 6,400 ReRAM cells to get 128 active cells useable for random number generation. Considering that at a point in time, half of the cells will have 54% oriented in one direction while the other half have only 46% oriented in the other direction, the mean distribution is centered at 64 bits in each state, like true random numbers. To improve the randomness the following methods may be implemented for various method implementations. First, a much larger number of ReRAM cell candidates may be selected for use in random number generation which means that the generation can take place using new cells of random state. The 128 candidate cells for random number generation can be selected in an order that is random, which then makes this randomness cumulative with the randomness of the state of each cell. The manufacturing variation of Vset may be tightened which increases the ratio of the cells at the threshold between 0s and 1s. For example, if the 4% of non-blanked cells turns into 10%, only 2,500 cells would be needed to generate 128 bit random numbers, and the 46% to 54% ratio could be improved closer to 50%. Those of ordinary skill will appreciate how to use the principles disclosed in this document to create other methods and systems for generating random numbers using PUF patterns.

Random number generating systems and related methods will now be described in more detail. Using power-up SRAM state as a source of random number generation has been described in “Power up SRAM State as an Identifying Fingerprint and Source of True Random Numbers,” by Daniel E. Holcomb, et al., published in IEEE Trans. on Computers, 2009, vol. 58, Issue No. 9, September, the entire disclosure of which is incorporated herein by reference.

Random Number Generators (RNGs) designed with memories containing ternary states may be based on commercially available memory architectures. The ternary states (the Xs) allow the selection of the cells that are unstable, and can easily switch back and forward from a 1 to a 0. The remaining 0s or 1s may be ignored for the purpose of creating RNGs. The resulting data streams extracted from these methods have a high level of randomness that can benefit from other methods of randomization. Resistive RAMs (ReRAMs) may be used for such random number generation because of their greater immunity to side channel attacks such as DPA and electromagnetic interference (EMI). With ReRAM, RNG data rates can be extremely fast, reaching the 1 Gbit/sec level.

Memory based RGNs exist in the art, including using SRAM, DRAMs, Flash RAMs, Resistive RAMS, and spin-transfer torque magnetoresistive random-access memory (STT MRAM). In some cases, memory arrays have been used in a randomization process to store bits during permutations or other mathematical computation. In other cases, the natural physical parameter variations due to small manufacturing variations have been exploited for RNGs, using methods similar to those applied to extract PUF challenge and response pairs. Table 4 shows some of the characteristics of some memory types used for random number generation (RNG). Items of interest are level of secrecy/security, randomness, and data rates.

TABLE 4 Example of RNG Memory Type generation Comments RAM Function generator + Does not utilize physical instruction generator in a randomness RAM NV-RAM Leverage randomness in a Complicated non-volatile memory 6T-SRAM Random flip of the 6T cell: Not secret/secure start as a 0 or a 1 after power up PROM Manage autocorrelation Not secret/secure Compute with Parallel arrays of memory No physical parameters memory cells added to increase the randomness

As described to some extent above, to reduce exposure to side channel attacks such as differential power analysis (DPA) it is effective to pair 0s and 1s together and create a 0, 1 pair as a 0 and a 1, 0 pair as a 1. Logic processors will consume the same current to process a 0, 1 pair as a 1, 0 pair. The states 1, 1 and 0, 0 are byproducts of such architecture, and can be used to process ternary logic. Ternary logics and TCAMs have been implemented to dispatch Internet Protocol (IP) packets through routers. These additional states can be used for cryptography.

The methods described herein for RNGs utilize the small cell-to-cell micro-manufacturing variations present in memory arrays. Several physical parameters defining the memory arrays vary due to these micro-manufacturing variations. As described previously with respect to FIG. 4, it is possible to identify three types of cells based on the spread of a given physical parameter: some read as clear 0s, some read as clear 1s, and some close to the transition point can easily flip from either state every time the cell is characterized. These ternary states, termed Xs herein, are the ones selected for random number generation (RNG). Methods to test the quality of the cells in memories can be slow, up to a few seconds. Built-in-self-test (BIST) can be implemented as a testing method. The segmentation of the memory to set aside X cells may be done in advance of the need to deliver a random number, thereby reducing the impact of test slowness from the perspective of the user.

FIG. 20 representatively illustrates a method which uses a memory array for the generation of random numbers including through the identification and storing of ternary X states. This may be implemented using an algorithm. First, the memory is configured by being segmented by pairs of rows. The cells of the first row of each pair (referred to as the “active row”) will be utilized for the generation of random numbers. The cells of the second row of each pair (referred to as the “companion row”) are where complementary information will be stored to describe the three states 0, 1, and X. In other implementations the memory may be segmented by pairs of columns rather than pairs of rows with each pair using the active column and companion column.

Physical parameters are then measured to determine the status (i.e. 0, 1, or X) of all cells of the active rows. In implementations only cells close to the transition point with a high level of randomness between 0s and 1s are selected as Xs for RNG applications. The stability of all X cells are tested such as, by non-limiting example, using BIST to ensure they are responding with an appropriate level of randomness, and to ensure they do not have predictable defects. In implementations the stability of the 1 and 0 cells may be similarly tested. This testing may be done at multiple temperatures, similar to other testing described above. Upon completion of testing all cells in the active rows (or active columns, as the case may be), are sorted as 1s, 0s, and Xs.

Once the testing has been done, the cells may be sorted into three categories. Cells that are below a first threshold may be categorized as 0s, cells that are above a second threshold may be categorized as 1s, and cells in between the first and second threshold that are unstable and have a likelihood of flipping greater than some defined percentage β, may be categorized as Xs (naturally, in other implementations those categorized as 1s and 0s could be reversed).

For the 0 state, a 0 bit is programmed in the active cell and a 1 bit is programmed in the companion cell. For the 1 state, a 1 bit is programmed in the active cell and a 0 bit is programmed in the companion cell. For the X state, both bits in the active cell and the companion cell are programmed identically, either a 0, 0 configuration or a 1, 1 configuration. The mapping of the memory is thus somewhat similar to that described above with regards to FIG. 4. The position of the Xs are then downloaded and stored to the memory block of a secure server.

FIG. 21 representatively illustrates an implementation of a method to extract random numbers from the memory with ternary states, and describes how additional randomness may be utilized to improve the RNG quality. The method shown in FIG. 21 is only one of many representative examples.

After the power-up cycle, only the X cells are tested. A fresh determination is made on each cell to determine whether the physical parameter described with respect to FIG. 4 is falling on the right of the central line or on the left. If the result for a particular cell is falling on the left then, in the representative example, a 0 is programmed, while if the result is falling on the right side, a 1 is programmed (though as described above this configuration could be reversed in some implementations). Because the X cells are close to the tipping point, each time a fresh determination is made on the states of the X cells a high level of randomness may be expected.

FIG. 21 shows that a random ordering method may then be used to order the pattern generated by the ternary memory, and this random ordered version may be stored in a different memory or in a different part of the array of the same memory. A mathematical ordering method such as, by non-limiting example, an invert modulo, may be used for this random ordering. The resulting pattern benefits from the dual randomness effects offered by the X cells of the ternary memory and the randomness of the mathematical method used to extract the original pattern.

A secure server driving the system, which may include a crypto-processor or other logic processing block, may extract the random number from the memory arrays in which it is stored in advance for cryptographic purposes. If a fast memory type is used (ReRAM, SRAM, and so forth) the extraction rate of the random number (RN) may reach 1 GBit/sec.

An example of a system 20 that generates random numbers from a memory containing ternary states is shown in FIG. 22. In this example a crypto-processor 16 (shown as a block element) is driving the memory system. The crypto-processor can be integrated into the same die as the memory system or may be integrated in a separate processor driving the overall application. The crypto-processor can trigger on a regular basis, in advance, the preparation of a random number (RN) by the memory system 18. This can be done after powering up the system, or at any time during normal operation. The memory can then prepare the RN. Subsequently, a new request for the RN may be communicated from the crypto-processor to the memory system. This can trigger an extremely fast response because the RN has already been prepared.

Referring to FIG. 14, in order to model realistic ReRAM random number generation (RNG), Cu/TaO_(x)/Pt resistive devices were fabricated in a crossbar array on a thermally oxidized Si wafer 6 with a layer 8 of SiO₂ 800 nm thick. Such a design may be found in the paper by Gargi Ghosh and Marius Orlowski, “Write and Erase Threshold Voltage Interdependence in Resistive Switching Memory Cells,” IEEE Transactions on Electron Devices V. 62, No. 9, p. 2850-2857 (2015), described above. Both metal electrodes and solid electrolyte were deposited by E-beam evaporation and patterned by lift-off techniques. The oxygen-deficient TaO_(x) layer 10, 16 nm thick, was deposited by evaporating TaO_(x) pellets without O₂ injection to the evaporation chamber. In the memory cell design, the top Cu electrode 12, 150 nm thick, runs perpendicularly to the bottom Pt electrode 14, which was 60 nm thick and included titanium. The width of the metal lines varied between 1 micron and 35 microns.

A single Cu/TaO_(x)/Pt switch relies on electrochemical formation and rupture of a conductive filament (CF) bridging the TaO_(x) dielectric 10 between the active Cu electrode 12 and the inert Pt electrode 14. Referring to FIG. 15, there is a minimum Vset voltage at which the CF is being formed. When the voltage applied to the Cu electrode 12 is pulsed or swept at a positive voltage, the current remains substantially zero until a critical voltage Vset is reached, at which a Cu CF is formed that connects the Cu electrode 12 and Pt electrode 14. The memory cell then switches from a high resistive state (HRS) characterized by an Roff of 1-900 megaohms to a low resistive state (LRS) characterized by an Ron of 70-6000 ohms, yielding a ratio of Roff/Ron of approximately 10³-10⁷. When a negative voltage is applied to the LRS state, the CF ruptures at a critical voltage of Vreset and the cell switches from the LRS to the FIRS state. The rupture of the CF is triggered by a critical current Ireset=Vreset/Ron. Therefore, to ensure a successful set operation to logic state 1, the magnitude of the applied maximum voltage must be slightly larger than the magnitude of the Vset voltage for the particular memory cell. Similarly, programming a logic 0 requires a reset maximum voltage slightly larger in magnitude than Vreset for a particular cell.

The cell's switching parameters (Vset, Vreset, Ron, and Roff) are all subject to statistical variations. The variability of cell parameters degrades memory operation margins and the functional array design; however, the variability lends itself to be used in security applications for random number generation. ReRAM may be very robust against physical attacks because the variations of the characteristic parameters (Vset, Vreset, Ron, and Roff) come from structural material properties and are the result of atomic level variation. Furthermore, the ReRAM variability is inherent not only from manufacturing variations, but also in the electro-chemical ionic switch mechanisms of the ReRAM device itself. A ReRAM device cannot be probed by invasive techniques as the atomic changes of the defect densities of the device during operation are hardly visible, even under high resolution transmission electron microscopy. ReRAM is also less sensitive to side-channel attacks due to the lower power characteristics during read cycles, as well as attacks based on photon emission analysis. ReRAM does not emit photons like hot carriers in MOSFET transistors in SRAM or in a floating gate MOSFET cell. ReRAM also may have intrinsically higher density, faster access speed, and better energy efficiency than other conventional memory technologies.

Referring to FIG. 16, a cumulative probability distribution of the Ron and Roff resistances of the ReRAM samples used in the experiment is illustrated. Either or both distributions could be used as a random source of variation for random number generation. The Roff distribution has the advantage that it has larger variation, and also, it can minimize the parasitic voltage drop outside the active structure. Preliminary data indicated that the resistance shift under temperature changes from 0 C to 85 C was less than 10% for both Ron and Roff.

Referring to FIG. 17, the cumulative probability distribution for the Vset parameter for the entire sample ReRAM array of 10,000 memory cells is illustrated. The variations of Vset may be used for random number generation. As illustrated, the mean of this distribution μ=2.1 V indicated by the dash line, and the standard deviation is σstd=0.545 V. In FIG. 17, there are two lines (first and second threshold values) at a distance of α*σstd from the mean, where a is an RNG design parameter. This voltage dependent switching probability becomes the source of the randomness used for the generation of random numbers. During the experiment, all the cells in the ReRAM memory array were first set to the HRS. Then, by biasing the memory cells at Vset=μ, every cell then was given an equal opportunity to be characterized as a 0 or a 1. In this approach, the mean μ and the standard deviation σstd are used to create two dividers (first and second threshold values) to associate with the three types/states of the memory cells.

During the memory preparation the cells were classified as 0, 1, or X depending on whether they fell below the first threshold μ−α*σstd, above the second threshold μ+α*σstd, or between the first and second threshold values, respectively. Those cells with a 0 state value below a minimum Vset (0.8V) were kept in the LRS on the active columns while the companion columns were programed as HRS (1). The cells with a 1 state value above a maximum Vset (3.4 V) are programmed as HRS (1) while the companion columns are programmed LRS(0). Those cells with an X state were programmed to the same state as the corresponding cell in the companion column (LRS/LRS or HRS/HRS).

During the experiment, the robustness of the RNG method was analyzed using the Vset distribution for several individual ReRAM cells. Referring to FIG. 18A, a cell with a low Vset value (Vset≈1 V) and referring to FIG. 18B, a cell with a high Vset value (Vset≈2.5 V) were selected from the distribution of memory cells in the array. Both cells were subjected to repeated reset and set operations under the same conditions. FIGS. 18A and B show the cumulative probability distributions of the Vset values for each cell. Vset distribution for the low Vset cell is centered around 1 V and its standard variation σstd=0.084 V is smaller than the overall variation of Vset σstd=0.545 V of the array. For the high Vset cell, the distribution is centered around 2.52 V and the σstd=0.158 V, also smaller than the array variation. From the physics of the ReRAM cell, it would be expected that a cell that requires high electric field (i.e., high Vset) will display larger variation than a cell that switches at lower electric fields (low Vset). The standard deviations for the single cells may influence the choice of RNG design parameters. Based on the experimental results, the variation of each cell is shown in FIG. 19 as a function of the average Vset of these individual cells, which shows the within cell standard deviation versus the average Vset. The statistical analysis based on this experimental data is presented in Table 3, above. In this analysis a varies from 0 to 0.15, and the analysis assumes normal distributions.

As was described above, in addition to the concept of using PUFs for authentication, the PUF generating methods and systems disclosed herein may also be used in cryptographic operations to generate random numbers to be used in encoding data being transmitted between devices. This is done by using the X cells to generate random numbers to be used in encrypting data. One method implementation is carried out by programming in advance the entire ReRAM arrays with 0s and 1s based on Vset determination. The cells that are close to the transition point are kept for random number generation, while the cells that are solidly 0s, 1s, and defective cells are simply blanked with an X. Table 3 summarizes a statistical analysis of such a method implementation using the data presented in FIG. 17. With α=0.05 representing 4% of the cells, the ratio I/O for a single cell is expected to be 46% 1s and 54% 0s for Xs below the dotted threshold, and 54% 0s and 46% 1s for Xs above the dotted threshold. This indicates that, overall, the likelihood that these cells will randomly be 1 or 0 is reasonably close to 50/50.

Assuming a normal distribution with N bits in a random number the probability P(n) to have n 1s is:

${P_{N}(n)} = {\frac{N!}{{n!}{\left( {N - n} \right)!}}p^{n}q^{N - n}}$ with p being the probability to have a 1 and q being the probability to have a 0. True random number generators will behave such that if N=128, p=0.5; P₁₂₈(64) is approximately 7.04% over 2¹²⁸=3.4×10³⁸ events. Thus the number of true random numbers with equal number of 0s and 1s out of 128 bits is 2.4×10³⁷.

If we assume with this method that N/2 bits (called X₀) were tested below the dotted line and have a probability of being a 1 of 46%, the other N/2 bits (called X₁) have a probability of being a 1 of 54%. P(64) is given by:

P₁₂₈(64) = Σ_(i = 0)⁶⁴P₆₄^(X₀)(i)P₆₄^(X₁)(64 − i) with P₆₄ ^(X) ⁰ (i) the probability for X₀ to be i times a 1 and P₆₄ ^(X) ¹ (64−i) the probability for X₁ to be 64-I times a 1.

Given these values, it would take about 6,400 ReRAM cells to get 128 active cells usable for random number generation. This is a relatively small size considering that commercial memories can contain Gigabits worth of cells. Considering that at a point in time, half of the cells will have a 54% of being oriented in one direction while the other half have only 46% chance of being oriented in the same direction, the mean distribution of random numbers generated by the method is centered in the same mid-point 50%-50% of a normal distribution (64 bits in each state) like truly random numbers.

In short, the experimental results show that: (1) in a ReRAM array it is possible to sort out a large amount of cells that can have a large probability to switch back and forward between 0s and 1s; (2) such a selected set of cells can yield a distribution of 0s and 1s centered in a 50%-50% distribution like true random numbers. This experimental data shows validity of the apparatus and methods to generate random numbers with resistive RAMs segmented with ternary states.

To improve the randomness, the following methods may be implemented for various method implementations. First, a much larger number of ReRAM cell candidates may be selected for use in random number generation which means that the generation can take place using new cells of random state. The 128 candidate cells for random number generation can be selected in an order that is random, which then makes this randomness cumulative with the randomness of the state of each cell. The manufacturing variation of Vset may be tightened which increases the ratio of the cells at the threshold between 0s and 1s. For example, if the 4% of non-blanked cells turns into 10%, only 2,500 cells would be needed to generate 128 bit random numbers, and the 46% to 54% ratio could be improved closer to 50%. Those of ordinary skill will appreciate how to use the principles disclosed in this document to create other methods and systems for generating random numbers using PUF patterns.

The devices and methods described herein for random number generation thus may have the following characteristics: the sorting of cells that are fundamentally unstable and susceptible to a high level of randomness; the methods are implementable into any commercial memories including ReRAMs which are well suited for secure applications; the methods are simple and do not compete with other randomization methods; the methods are synergistic with mathematically generated randomness; the methods can generate random numbers with data rates in the 100 Mbit/sec-1 Gbit/sec range.

In implementations the systems/devices and methods for random number generation may use the same sample of data that is used for PUF generation, but may use a narrower data sample range than what is used for PUF methods because it may be desirable to select only those Xs that have a probability above a certain percentage of flipping. The systems and methods may be designed to improve the Xs over time, such as by removing those Xs that are not repeatedly flipping. Memory used for RGN may or may not be the same memory used for PUF—they may include different circuits or may be implemented in the same circuit.

The above random number generation systems and methods may also be used for encryption/cryptographic keys.

In the methods disclosed above for random number generation, the X cells may be periodically tested to generate new random numbers. An RNG data stream may include, therefore, new random numbers in the data stream on occasion. The RNG data stream may be used to create a portion of a data payload of a data packet. This could include, by non-limiting example, including the RNG data stream (or a random number generated using the RNG data stream) in the data payload, wherein the random number (or RNG data stream) identifies where in the data payload relevant data is to be found. The data payload could, for example, include additional data bits in addition to what otherwise would be included in the packet, used for encryption, and the random number or RNG data stream may point the receiving device/computer to where in the data packet the relevant data is to be found. A random number could, for instance, be used to modify or define an identification tag, a fragment office, or some other element to provide encryption/decryption.

The RNG data stream at the bottom left of FIG. 21 could therefore be heading towards a data packetizer, and/or may be used to generate an encryption key, and the like. The RNG data stream could also be used to generate one or more other random numbers (the RNG data stream could for example include one or more initial random numbers that are then used to seed or generate additional random numbers for encryption purposes). Accordingly, the RNG data stream could be used to generate multiple random numbers.

One or more random numbers may be used, for example, to encrypt plaintext using an encryption algorithm to generate ciphertext that can only be read once decrypted. The encryption scheme may use random encryption keys generated by the encryption algorithm. The RNG stream at the bottom left of FIG. 21 may thus directly generate such random encryption keys or it may be modified and/or used to further generate an encryption key for an encryption algorithm.

One or more random numbers could thus be used to generate an encryption key which is included at the beginning, at the end, or somewhere within a data packet containing encrypted plaintext. A recipient computer or device could use a matching or correlated encryption key to decipher/decrypt the encrypted plaintext.

Two secure devices/elements, whether secure servers or other elements, could use the above PUF techniques/elements for authentication and/or could use the above RNG methods/elements for data payload encryption.

The key size of an encryption key may be sized to have increased security. In implementations encryption keys generated using the RNG data stream may have a 128 bit, 192 bit, or 256-bit key size. An encryption key having a 128-bit key size has 3.4×10³⁸ possible combinations. At one encryption per microsecond this results in an average exhaustive key search time of 5.4×10²⁴ years. At 10⁶ encryptions per second this results in an average exhaustive key search time of 5.4×10¹⁸ years. An encryption key having a 192-bit key size has 6.2×10⁵⁷ possible combinations. An encryption key having a 256-bit key size has 1.1×10⁷⁷ possible combinations. Encryption keys having sizes of 128 bits, 192 bits, and 256 bits may be used for symmetrical cryptography techniques under the Advanced Encryption Standard (AES) established by the National Institute of Standards and Technology (NIST) of Gaithersburg, Md.

Random numbers generated using the techniques and methods disclosed herein may be used to begin generation of public and/or private keys for asymmetric cryptography. This is representatively illustrated in FIG. 23, wherein one user (Alice) has a public and a private key generated using a random number and another user (Bob) has a public and a private key generated using the same or a different random number. Various key exchange schemes can be used. Any of the RNG methods described herein, and the RNG data stream described herein, may be used for generation of the public and private keys. The top image of FIG. 23 shows encrypted plain text sent from Alice (A) to Bob (B) and decrypted at B's end. The middle image shows an encrypted certificate sent from A to B and decrypted at B's end. The bottom images show a certified text, which includes both plain text and a certificate, decrypted at B's end.

The certificates S, in implementations, will include random numbers to increase the size of the plain text, and in implementations these random numbers may be generated using the RNG data stream (either directly or through manipulation to form new random numbers).

Random numbers generated using the RNG data stream may be used for padding in an AES encryption stream. In implementations, one or more AES or asymmetric encryption keys could be generated using one or more of the PUF methods/techniques described above. In implementations, an RNG data stream may be utilized to create 56 bit keys for utilization in encryption methods under the Data Encryption Standard (DES) (one 56-bit key), double DES (two 56 bit keys), two-key triple DES (two 56 bit keys), and/or three key triple DES (three 56-bit keys). In implementations an RNG data stream may be utilized to create public and/or private keys for a Rivest Shamir Adlemen (RSA) asymmetrical encryption method. This typically utilizes 1,000-2,000 bit keys and may be about about 1,000 times slower than DES/AES for encryption/decryption.

Elements of random number generation and PUF elements as described herein may be together integrated for use of both in security measures. In some implementations edit distancing may be used for multi-authentication. FIG. 24 shows a conventional method of multi-function authentication in which three authentication patterns much each be authenticated in order for authentication to complete. PUF authentication as described above could use such an authentication model in which each authentication pattern is independently authenticated. Alternatively, a method such as that shown in FIG. 25 may be utilized in which authentication patterns are combined (first Patterns 1 and 2 are combined and then the 1+2 combined Pattern is combined with Pattern 3) to create a combined 1+2+3 Pattern, which is then authenticated. Naturally, any number of PUF or other patterns may be used other than three patterns.

FIG. 26 shows the use of a base 10 edit distance algorithm that may be used for the method shown in FIG. 25. The Authentication Pattern #1 is 01010101010101010101. Authentication Pattern #2, which is 34, results in the placement of an X (which may be representative of one or more other elements) after the first three bits and the placement of an X after the 14th bit, giving the combined 1+2 pattern of 010X1010101-0101X010101. Authentication Pattern #3, which is 67, results in the placement of an X (which may be representative of one or more other elements after the 6th it and after the 17th bit, resulting in the combined 1+2+3 pattern of 010X10X1010-10101X0X10101. FIG. 27 shows a rolling edit distance algorithm (i.e., not base 10) which is similar in some ways to that shown in FIG. 26 and which may be used for the method shown in FIG. 25. At the first combination of patterns 1+2 one X is placed after the first 3 bits and another after the next 4 bits, resulting in the combined 1+2 pattern of 010X1010X1010101010101. At the combination of the 1+2 pattern with the 3 pattern an X is placed after the first 6 bits and another after the next 7 bits resulting in the combined 1+2+3 pattern of 010X10X1010X10X101010101.

In implementations the combination of patterns and the authentication of combined patterns may be implemented in an embedded authentication integrated circuit (IC) as representatively illustrated in FIG. 27. The IC includes a central processing unit (CPU) having an arithmetic logic unit (ALU) which is used to form the combined secure patterns, and the combined secure pattern may be communicated to a memory circuit and/or stored therein and/or compared for authentication purposes.

In other implementations multiple edit distance models may be used. Multiple authentication methods for authenticating computing devices and/or for sending and encrypting/decrypting data may include biometry, PUF methods as disclosed herein, and cryptographic keys as disclosed herein.

Edit distance algorithms such as, or similar to, those described above could be used for the placement and/or location of relevant data within a data packet and/or keys and the like generated using RNG methods as described herein may be utilized for the placement and/or locating of the relevant data within the data packet.

Any of a variety of number theories and/or mathematical operations may be used to generate random numbers from an RNG data stream for encryption purposes, and numbers may be modified multiple times to achieve multiple encryptions (and correspondingly multiple operations may be performed to achieve the decryptions). These mathematical operations may include, by non-limiting example: mathematical operations using the Fermat-Euler theorem; operations using Fermat's little theorem; defining an integer m≠0 where x is congruent toy modulo m (notation x mod(m)=y) if m|(x−y), or ∈ integer k such as x−y=km; letting a, b, c, d, m, and n be integers where m≠0, a mod(m)=b and c mod(m)=d, then (a+c)mod(m)=(b+d), (a−c)mod(m)=(b−d), ac mod(m)=bd, a^(n) mod(m)=b^(n), a/n mod(m)=b/n if n|a and n|b; every a∈Z_(n), a≠0 having a unique multiplicative inverse a⁻¹ in Z_(n) with the equation aa⁻¹ mod(m)=1 (for example for n=14, 3⁻¹=5 (3×5=14+1), 9⁻¹=11 (9×11=(14×7)+1)); for an integer n>0 defining Φ(n)=number of positive integers lower than n relatively prime to n (for example for n=15, Φ(15)=8 (1, 2, 3, 4, 5, 6, 7,8, 9, 10, 11, 12, 13, 14))—if n is prime then Φ(n)=(n−1); if p, q are primes and n=p×q, then Φ(n)=Φ(p)×Φ(q)=(p−1)×(q−1).

Asymmetrical encryption using RSA techniques may include: selecting p and q such that p and q are prime and p is not equal to q; calculating n=p×q; calculating Φ(n)=(p−1)(q−1); selecting an integer e such that gcd(Φ(n),e)=1; 1<e<Φ(n); calculating d such that d×e modΦ(n)=1 to create a public key Kpub={e, n} and a private key Kpriv={d, n}. Encryption may then take place such that plaintext P<n and cyphertext C=P^(e) mod n. Decryption then may take place such that cyphertext=C and plaintext P=C^(d) mod n. Simplified versions of RSA encryption may include elliptic curves, digital signatures, and the like.

Asymmetrical RSA encryption with e and decryption with d may take place using the following relationships: C^(d) mod n=(P^(e) mod n)^(d) mod n=P^(ed) mod n=P^(k)(Φ^((n)+1)) mod n=P, and C=P^(e) mod n, ed mod Φ(n)=1>>>exd=kΦ(n)+1 (Euler-Fermat). Asymmetrical encryption with d and decryption with e may take place using the following relationships: C^(e) mod n=(P^(d) mod n)^(e) mod n=P^(dxe) mod n=P^(k)(Φ^((n)+1)) mod n=P, and C=P^(d) mod n, dxe mod Φ(n)=1 (Euler-Fermat).

Any of the above mathematical operations may be utilized singularly and/or in combination with other mathematical operations (and other mathematical operations not described herein may also or alternatively be used), beginning with the RNG data stream to provide multiple levels of encryption/decryption of data to be placed in a data packet.

In places where the description above refers to particular implementations of PUF generating systems and implementing components, sub-components, methods and sub-methods, it should be readily apparent that a number of modifications may be made without departing from the spirit thereof and that these implementations, implementing components, sub-components, methods and sub-methods may be applied to other PUF generating systems. 

What is claimed is:
 1. A method of identifying a memory cell state for use in random number generation (RNG), the method comprising: comparing at least one physical parameter of a memory cell with a threshold value of the physical parameter; identifying a relationship of the at least one physical parameter of the memory cell to the threshold value; associating one of a 0, 1, and X state to the memory cell based on the relationship of the at least one physical parameter to the threshold value; programming at least one state storage memory cell to store a programmed value corresponding with the associated 0, 1, or X state; including the programmed value of the at least one state storage memory cell in a RNG data stream; and using the RNG data stream to create a portion of a data payload of a data packet.
 2. The method of claim 1, wherein the memory cell is a first memory cell and the at least one state storage memory cell is at least a first state storage memory cell, and the method further comprises: comparing at least one physical parameter of a second memory cell with the threshold value of the physical parameter; identifying a relationship of the at least one physical parameter of the second memory cell to the threshold value; associating one of the 0, 1, and X state to the second memory cell based on the relationship of the at least one physical parameter to the threshold value; programming at least one second state storage memory cell to store a programmed value corresponding with the associated 0, 1, or X state, and; including the programmed value of the at least one second state storage memory cell in the RNG data stream.
 3. The method of claim 1, wherein the at least one state storage memory cell is the memory cell itself.
 4. The method of claim 3, wherein the first state storage memory cell is comprised in a first row of memory cells and the second state storage memory cell is comprised in a second row of memory cells adjacent to the first row.
 5. The method of claim 3, wherein the first state storage memory cell is comprised in a first column of memory cells and the second state storage memory cell is comprised in a second column of memory cells adjacent to the first column.
 6. The method of claim 1, wherein programming at least one state storage memory cell further comprises programming a first state storage memory cell and a second state storage memory cell and: if the associated state of the memory cell is a 0, programming a 0 in the first state storage memory cell and programming a 1 in the second state storage memory cell; if the associated state of the memory cell is a 1, programming a 1 in the first state storage memory cell and programming a 0 in the second state storage memory cell; if the associated state of the memory cell is an X, programming one of a 0 in the first state storage memory cell and a 0 in the second state storage memory cell and programming a 1 in the first state storage memory cell and a 1 in the second state storage memory cell.
 7. A method of identifying a memory cell state for use in random number generation (RNG), the method comprising: comparing at least one physical parameter of a memory cell with a threshold value of the physical parameter; identifying a relationship of the at least one physical parameter of the memory cell to the threshold value; associating one of a 0, 1, and X state to the memory cell based on the relationship of the at least one physical parameter to the threshold value; programming at least one state storage memory cell to store a programmed value corresponding with the associated 0, 1, or X state, and; including the programmed value of the at least one state storage memory cell in a RNG data stream; wherein the RNG data stream is an RNG binary data stream comprising 0 and 1 programmed values.
 8. The method of claim 7, wherein the memory cell is selected from the group consisting of a static random access memory (SRAM), an SRAM-based ternary content-addressable memory (TCAM), a NAND flash memory, a NOR flash memory, a dynamic random access memory (DRAM), a resistive random access memory (ReRAM), a magnetic random access memory (MRAM), a spin transfer torque MRAM (STT MRAM), an electrically erasable programmable read-only memory (EEPROM), and any combination thereof.
 9. A method of random number generation (RNG) using memory cell states, the method comprising: comparing a physical parameter of each of a plurality of memory cells of a computing device with a first threshold value of the physical parameter and with a second threshold value of the physical parameter; identifying a relationship of each of the plurality of memory cells to the first threshold value and to the second threshold value; associating a 0 state to a first subset of the plurality of memory cells based on the relationship of the physical parameter of each memory cell of the first subset to the first threshold value; associating a 1 state to a second subset of the plurality of memory cells based on the relationship of the physical parameter of each memory cell of the second subset to the second threshold value; associating an X state to a third subset of the plurality of memory cells, wherein the physical parameter of each memory cell of the third subset is between the first threshold value and the second threshold value; programming a plurality of state storage memory cells to store programmed values corresponding with the third subset of memory cells having the X state; and including the programmed values of the third subset of memory cells in an RNG data stream.
 10. The method of claim 9, further comprising using the RNG data stream to create a portion of a data payload of a data packet.
 11. The method of claim 9, further comprising periodically testing the third subset of memory cells to generate new random numbers.
 12. The method of claim 9, further comprising randomizing an order of the programmed values corresponding with the third subset of memory cells prior to their inclusion in the RNG data stream.
 13. The method of claim 12, wherein randomizing the order of the programmed values corresponding with the third subset of memory cells is performed by a cryptoprocessor.
 14. The method of claim 9, further comprising retrieving, using a cryptoprocessor, the RNG data stream for communicating one of the RNG data stream and a random number generated using the RNG data stream.
 15. The method of claim 9, further comprising programming a plurality of state storage memory cells to store programmed values corresponding with the first subset of memory cells having the 1 state and programming a plurality of state storage memory cells to store programmed values corresponding with the second subset of memory cells having the 0 state, wherein programming the plurality of state storage memory cells further comprises programming for each memory cell having the 1 state a 1 in a first state storage memory cell and a 0 in a second state storage memory cell, programming for each memory cell having the 0 state a 1 in a first state storage memory cell and a 0 in a second state storage memory cell, and programming for each memory cell having the X state one of a 1 in a first state storage memory cell and a 1 in a second state storage memory cell and a 0 in a first state storage memory cell and a 0 in a second state storage memory cell.
 16. The method of claim 9, wherein the RNG data stream is a binary RNG data stream comprising 0 and 1 programmed values.
 17. A method of random number generation (RNG) using memory cell states, the method comprising: comparing a physical parameter of each of a plurality of memory cells of a computing device with a first threshold value of the physical parameter and with a second threshold value of the physical parameter; identifying a relationship of each of the plurality of memory cells to the first threshold value and to the second threshold value; associating a 0 state to a first memory cell of the plurality of memory cells based on the relationship of the physical parameter of the first memory cell to the first threshold value; associating a 1 state to a second memory cell of the plurality of memory cells based on the relationship of the physical parameter of the second memory cell to the second threshold value; associating an X state to a third memory cell of the plurality of memory cells, wherein the physical parameter of the third memory cell is between the first threshold value and the second threshold value; programming a plurality of state storage memory cells to store programmed values corresponding with the first memory cell by storing a 1 in a first state storage memory cell associated with the first memory cell and a 0 in a second state storage memory cell associated with the first memory cell; programming the plurality of state storage memory cells to store programmed values corresponding with the second memory cell by storing a 0 in a first state storage memory cell associated with the second memory cell and a 1 in a second state storage memory cell associated with the second memory cell; programming the plurality of state storage memory cells to store programmed values corresponding with the third memory cell by storing one of a 0 in a first state storage memory cell associated with the third memory cell and a 0 in a second state storage memory cell associated with the third memory cell and a 1 in the first state storage memory cell associated with the third memory cell and a 1 in the second state storage memory cell associated with the third memory cell, and; including one or more of the programmed values of the third memory cell in an RNG data stream.
 18. The method of claim 17, wherein the plurality of state storage memory cells is comprised in one of a static random access memory (SRAM), an SRAM-based ternary content-addressable memory (TCAM), a NAND flash memory, a NOR flash memory, a dynamic random access memory (DRAM), a resistive random access memory (ReRAM), a magnetic random access memory (MRAM), a spin transfer torque MRAM (STT MRAM), an electrically erasable programmable read-only memory (EEPROM), and any combination thereof.
 19. The method of claim 18, further comprising generating, using the RNG data stream, one of an AES encryption key and an asymmetric encryption key. 